Public transportation in Mount Vernon is available via the Skagit Transit (http://www.skat.org/) bus service. Cost for bus service is extremely reasonable. However the buses do not run at night, so you have to be careful you do not get stranded.
Due to the size of the city, it is easy to travel by bike.